Papers with entity representation

13 papers
PreCo: A Large-scale Dataset in Preschool Vocabulary for Coreference Resolution (D18-1)

Copied to clipboard

Challenge: Existing methods for coreference resolution are based on word2vec-like representations of entities.
Approach: They propose a large-scale English dataset for coreference resolution . they use 38K documents and 12.5M words from English-speaking preschoolers .
Outcome: The proposed dataset is more efficient with higher training-test overlap than OntoNotes . the study also shows that mention detection and clustering are more efficient on PreCo .
Bilateral Masking with prompt for Knowledge Graph Completion (2024.findings-naacl)

Copied to clipboard

Challenge: Existing word matching methods fail to obtain satisfactory single embedding representations for entities.
Approach: They propose a bi-encoder-based approach to enhance entity representations by using prompts to narrow the distance between the predicted entity and the known entity.
Outcome: The proposed model achieves state-of-the-art performance on the WN18RR dataset.
An Improved Baseline for Sentence-level Relation Extraction (2022.aacl-short)

Copied to clipboard

Challenge: Sentence-level relation extraction (RE) aims at identifying the relationship between two entities in a sentence.
Approach: They propose to improve sentence-level relation extraction by adding entity representations with typed markers to the model.
Outcome: The proposed model outperforms existing methods on entity representation and noisy labels on TACRED dataset.
TranS: Transition-based Knowledge Graph Embedding with Synthetic Relation Representation (2022.findings-emnlp)

Copied to clipboard

Challenge: Knowledge graph embedding (KGE) is a computational approach to learn continuous vector representations of relations and entities in knowledge graphs.
Approach: They propose a transition-based method to learn continuous vector representations of relations and entities in knowledge graph (KG) it replaces a single relation vector in the relation part with a synthetic relation representation with entity-relation interactions to solve these problems.
Outcome: The proposed method achieves state-of-the-art on a large knowledge graph dataset.
Entity-level Cross-modal Learning Improves Multi-modal Machine Translation (2021.findings-emnlp)

Copied to clipboard

Challenge: Multi-modal machine translation aims at improving translation performance by incorporating visual information.
Approach: They propose an explicit entity-level cross-modal learning approach that aims to augment the entity representation by combining a translation task and a reconstruction task.
Outcome: The proposed approach achieves comparable or even better performance than state-of-the-art models.
Pay More Attention to Relation Exploration for Knowledge Base Question Answering (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches focus on entity representation and final answer reasoning, which results in limited supervision for this task.
Approach: They propose a framework that utilizes relations to enhance entity representation and introduce additional supervision.
Outcome: The proposed framework improves the F1 score on two benchmark datasets by 5.8% . it improves by 6.7% on WebQSP, better than state-of-the-art methods .
Open Domain Question Answering based on Text Enhanced Knowledge Graph with Hyperedge Infusion (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to improve knowledge base are incomplete and difficult to understand.
Approach: They propose a novel QA method by leveraging text information to enhance the incomplete KB.
Outcome: Extensive experiments on the WebQuestionsSP benchmark prove the effectiveness of the proposed model.
SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation (2022.findings-emnlp)

Copied to clipboard

Challenge: Named geographic entities are the building blocks of many geographic datasets.
Approach: They propose a spatial language model that provides a general-purpose geo-entity representation based on neighboring entities in geospatial data.
Outcome: The proposed model improves on two downstream tasks, showing significant performance improvement compared with existing models that do not use spatial context.
Multi-modal Contrastive Representation Learning for Entity Alignment (2022.coling-1)

Copied to clipboard

Challenge: Existing studies focus on how to utilize information from different modalities, but it is not trivial to leverage multi-modal knowledge in entity alignment because of the modality heterogeneity.
Approach: They propose a Multi-modal Contrastive Learning based Entity Alignment model which learns multiple individual representations from multiple modalities and performs contrastive learning to jointly model inter-modal and inter-modal interactions.
Outcome: The proposed model outperforms state-of-the-art models on public datasets under both supervised and unsupervised conditions.
Contextualize Knowledge Bases with Transformer for End-to-end Task-Oriented Dialogue Systems (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to integrate knowledge bases into end-to-end task-oriented dialogue systems are limited in their ability to properly represent the entity of KB.
Approach: They propose a framework that dynamically perceives all relevant entities and dialogue history . it uses a Memory Mask to enforce the entity to focus on its relevant entities .
Outcome: The proposed framework can achieve superior performance over the state of the arts.
Counterfactual Generator: A Weakly-Supervised Method for Named Entity Recognition (2020.emnlp-main)

Copied to clipboard

Challenge: Using labeled data, named entity recognition is labor-intensive, time-consuming and expensive.
Approach: They propose a method which decomposes named entity into two parts: entity and context.
Outcome: The proposed method improves the generalization ability of models under limited observational examples.
ET-MIER: Entity Type-guided Key Mention Identification and Evidence Retrieval for Document-level Relation Extraction (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing work does not fully distinguish the contribution of different mentions to entity representation and the importance of mentions in evidence sentences.
Approach: They propose a document-level relation extraction task that uses entity mentions to identify relations between entities in a text.
Outcome: The proposed model achieves state-of-the-art on widely-adopted datasets.
Factual Retrieval in LLMs Is a Redundant, Distributed and Non-Contiguous Process (2026.acl-long)

Copied to clipboard

Challenge: Existing work posits that factual knowledge is stored at the last entity token position, but the precise mechanics of how facts are retrieved from model parameters remain unclear.
Approach: They propose an iterative patching protocol to identify a minimal subset of layers necessary for attribute retrieval.
Outcome: The proposed method shows that models possess multiple paths for the same entity and fact, highlighting a high degree of redundancy in attribute computation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations